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ABSTRACT 


Research was undertaken to investigate improving selec- 
tion criteria for several curricula at the Naval Postgraduate 
School using the Strong Vocational Interest Blank and a bio- 
Praphrecal questionnaire aS indicators of academic success 
and satisfaction with curriculum and future assignments. 

The seven curricula investigated were merged into three 
groups for analysis, and useful predictors of academic suc- 
cass were found for each group. Further effort 1s required 


for the prediction of satisfaction. 
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I. INTRODUCTION 


The research reported in this paper was carried out as 
part of a larger study at the Naval Postgraduate School (NPS) 
during 1973 and 1974. The goal of the NPS study was to de- 
VoLopmiic LlodSmtonese Necting Uso. Navy offacersgtor graduate 
education who would do well academically and be satisfied 
with the material they studied and want to be assigned to 
jobs utilizing their education. This paper describes re- 
search conducted at NPS which used the Strong Vocational 
Interest Blank (SVIB) as a predictor of both academic grades 


and satisfaction with graduate education. 





II. BACKGROUND 


The U.S. Navy and the other U.S. services plus the armed 
forces of many allies spend millions of dollars every year 
Sumbiemeraduate "education Of their officers. In recent 
times, about 570 Navy officers a year have received Navy 
funded graduate degrees at NPS. (Cong. Record, 1973, p. 
617.) The justification for these expenditures for graduate 
education has been that certain Navy officer billets require 
PIC IMNCcCuUMDCiemeOornlaves SUCH wan education in order @o perform 
optimally in the job. As a matter of fact, the identifica- 
tion and description of such billets is used to determine 
how many officers are required with Masters degrees in any 
given area, e.g., physics or financial management. Given 
these derived minimum educational needs, the U.S. Navy's 
Bureau of Personnel (BuPers), selects officers for graduate 
education programs at NPS and civilian universities. The 
officers and BuPers expect, and hope, that all officer/stu- 
dents will successfully complete their program and attain 
their graduate degree. The officer probably also hopes that 
he will enjoy his studies; BuPers and the rest of the Navy 
Should hope that the officer will desire to use his education 
in his later jobs, as that is how the officer's education 
will pay off in terms of the Navy's effectiveness. The best 
payoff to the Navy comes, then, when the officer does well in 


Studies that he enjoys. The remainder of this investigation 





focuses on research concerning the prediction of academic 


performance and satisfaction. 





‘III. THE STRONG VOCATIONAL INTEREST BLANK 


The Strong Vocational Interest Blank (SVIB) has been 
used in counseling and selection concerning civilian sector 
occupations for over 40 years in the United States. The 
SVIB was developed by contrasting responses to items (ex- 
pressaons of “Like,” “Indifferent,” or "Dislike" to items 
addressing activities, hobbies, reading materials, etc.) or 
people in an occupation with Men in General (MIG). The dis- 
criminating power of the responses to an item are expressed 
Timeee TNS mot SUN i tewel ohntsp, e¢.9. wl = 1, J = 0, DE= —1.o7, 
Eee), 1 = 0, Ds 41. The items differentiating between 
the occupation and the MIG group are then considered as 
forming a key for that occupation. An individual can then 
be scored using this key and his score compared with indi- 
viduals in that occupation. 

emo GON eit ty Let 100 5. D. To Set Orc Oli 
propositions concerning the SVIB. 

1. Men continuing in occupation A obtain a higher in- 
Penreceescore in A than in any other occupation. 

ae Ci CONtINnUINS INeoOCCUpatione Obtain a higher 
= Cen Caen etiLanie Mem Cmee rine OClcreoeccupallOns . 

oe Checonmtinuing im A obtain higher scores in A than 
men who change from A to another occupation. 

4. Men changing from A to B score higher in B prior to 


the change than in any other occupation including A. 





Over the ix oo years or so, these four propositions have 
becmmticmcr Welliemcorroborated (Tyler, 1965, p. 193). 

The longitudinal stability of SVIB scores is also im- 
pio oS Vom ca ycarmalntcrvals, the correlations among 
individuals' occupational interest scores are around .80 
andatighemea(strong, 1951, sp. 89-91). The stability of in- 
Demos cOrces SUSMintliucngced by two major factors (Tyler, 

PO 5em pe 190), 

1. Age when the SVIB was first taken. 

2. The interval of time between the test and retest. 
These two factors seem to be equally important in determining 
PicmoiiMtlarityebetween tesitt and retest SVIB occupational 
meOucom ly lone! 905.0. eo), 

IDeUeoeNavy wescarch uStmesthessVIB, positive, néesults 
have been obtained in predicting Naval Academy disenrollments 
(Abrahams and Neumann, 1973), NROTC disenrollments (Abrahams 
and Neumann, 1971), and in selecting NESEP men (Abrahams and 
Neumann, 1971), and Navy recruiters (Abrahams, Neumann and 
Rimlard, 1973 and Abrahams and Neumann, 1974). 

several recent situdies of the vuse of the Strong Vocation- 
al Interest Blank (SVIB) in prediction of academic achieve- 
ment offer evidence as to the effectiveness of this instrument 
for that purpose. Most of the studies relate to undergraduate 
academic achievement as measured by grade point average (GR Am 

These studies can generally be divided into two classes, 


those using the non-vocational scales (primarily the Academic 


10 





Achievement scale) as predictors and those relating the vo- 
Cacronaim seamless te scholastic performance. 

Hauntras, Lee and Hebahlran present a step-wise regres- 
Sion, with grade point average as the dependent variable, 
Ho lppeaiino tecine OCCUpatlomal §sicalesp Them@sample of 423 
male freshmen were divided into the six Holland classes 
(Realwstic, Intellectual, Artisitic, Conventional, Social 
and Enterprising) using the Holland Vocational Interest 
Blank Scores. For the entire sample the Strong Academic 
Achievement (AACH) score was the best predictor (r = .374), 
dismltewas fon the Realisitic Orientation igroup (r = .365), 
the Intellectual Orientation group (r = .420) and the 
ShieiscvesOrleneati1on wperoup (r =" .303). “All but tne Artis- 
Slew yroOup COciilGients WeNje Sileonmmm@icant at the” .01 level, 
Vitecnmevase Si onittcant at tne w05 level. ~The Occupational 
Level scale was the best predictor for the Conventionally 
Oriented (N = 412), with AACH the second best predictor. 

Johnson analyzed the SVIB results for 290 art/science 
and 98 business administration freshmen utilizing the Rust 
and Ryan achievement scales, the Martin AIS scales, the 
Self-rating Scale and the AACH scale. Johnson also calcu- 
lated a Predicted Achievement Score based on a combination 
of high school rank and the Scholastic Bt itude Test score. 
These correlations are Summarized on page 12. 

Campbell and Johansson in the original validation studies 
for the Academic Achievement scale (AACH) report a correla- 


tion between men's AACH score and GPA of .52 for a group of 


Wal 





Scale/Test Art/Science JS, USS esa) yd Bouin 


Rust-Ryan mie .O1 s(t 
ALS short a ys 14 OE 
Pe oe Ol o 09 aus .08 
Self-Rating ON eZ 05 
homtralnk &G 

SAT score aLos Bo a LA 
AACH Be ks OZ a oi 
“Data .O01 
a pe F. 05 


Minnesota freshmen, however for the freshmen cross validation 
group the coefficient dropped to .36. For another cross 
validation group made up of a twenty-five year follow-up 
sample, Campbell obtained a .35 correlation with grades. 
Using attained educational level for this latter sample an 
AACH mean score of 58 was found for PhD recipients, 52 for 
MA@Treciplents, 47 for BAYHeciplents, tand 42 mor those who 
obtained no degree. Almost a full standard deviation sepa- 
rated the PhD and the BA recipients. It is difficult to 
say, however, whether higher degrees reflect an AACH interest 
or if those with higher degrees develop a greater AACH in- 
terest. = inerease Him scores during the four college years 
Suggest the latter explanation. 

Lindsay and Althouse concluded that the AACH is not 
better than aptitude measures and past performance in pre- 


dicting@academic performance. For a sample of first-year 
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male students at Penn State the following correlations with 
weade Pommmuame tame were produced. AACH@10,°SAI verbal 
~-t9, SAT math .09 and high school GPA .38. For women the 
coctficients, were .25, .48, .45 and .29 respectively. In a 
multiple correlation analysis, when AACH was added to the 
SAT score and grade point average, multiple R was raised 
on] yveaseromens 17 7 tOme5 289 . 

At Illinois, Wagman found a correlation between grades 
and AACH of .35 for 193 graduate and undergraduate students. 
By comparison, the correlation between the Student College 
Aptitude Test and the grades was .39. 

Ina study relating, persistance. to pursue an engineering 
curriculum to occupational interests), Taylor and Hanson di- 
vided enpineering and former we ee students into four 
groups: (1) the academically successful who remained in the 
engineering program; (2) the successful students who trans- 
ferred Out Of senpaneering; (3) unsuccessful §students) who 
dropped out, and, (4) unsuccessful students who stayed in 
engineering. Higher scores were achieved by successful en- 
gineers than successful transfers in the following occupa- 
Plonwtwnmeimberests: SGarpenten, Printer, Parmer, Math science 
Teacher, and Veterinarian. The persistors had lower scores 
than the transfers for Personnel Ti seOOe are p 9 Seereall Science 
Teacher, School Superintendent, Life Insurance Salesman, 
Advertising, Lawyer and Journalist. The academically inade- 
CEacemwno aropped out ditfer from the successful persistors 


in that they achieved higher scores for Mortician and Social 


1s 





Science Teacher, and lower scores for Chemist and Psycholo- 
gist. The transfers had higher scores than those in the 
other three classifications for Personnel Director, School 
superintendent, Advertising, Lawyer, Journalist, Political 
Belentist, Sociologist and Occupational Level and lower in 
neo Math -Seimce Teacher, Veterinarian, Printer and 
the Mechanical score. The two groups of persistors scored 
higher than the withdrawers in Phychologist and Academic 
Achievement. Persistors made higher grades in Science than 
the non-persistors, and, regardless of their grades, those 
students with interest in solving math and science problems 
Stayed in the engineering curriculum. 

A 1969 study at NPS by Fernailld, et. al, found ‘high re- 
lationships between SVIB occupational scales and grade point 
averages using multiple regression methods. Unfortunately, 
they did not cross validate their equations, and, as they 
had used step-wise multiple regression procedures, it was 
impossible to estimate how much the obtained multiple cor- 


relations would shrink in a new sample (Thorndike, p. 205). 
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yee ROCEDURE 


Werte sca meve ol O/ 4 Sotlicer/ studentspin sa number of 
Srprvecllasat Nesewerewadministeredtthe SVIB. Ihe curricula 


and numbers of individuals sampled are given in Table I. 


Table I. 


GHKinnacuLarsana Numbers of OfFflcer/ Students 
in the SVIB Sample 


Curriculum Number of Officer/Students Taking SVIB 

360 OpsRes./SysAnal. 80 
367 CompSysMegt. 48 
Saeeeonp . GLence _ 24 
610 AeroEng. 103 
620 ComMgt. 42 
816 SysAcaqMet. 2 
Shy tge. cl) 

479 


The officer/students in these aerial a range from ensign 
to Commander in military rank and from about 22 to 40 in age. 
The Navy officers included in the sample were chaplains, 
pilots, surface ship officers, submariners, engineering duty 
OLiteclsS mand Supplyeottiteerse 

Following the collection of the SVIB answer sheets, the 
forms were sent to the Navy Personnel Research and Develop- 
Netemeecmeem (NPRUC)Bin canmi1ecoomeealitornia, where (the in- 
dividuals' responses were processed and scored. Each 
officer/student was scored in terms of the similarity between 


his responses to the SVIB and the responses of individuals 


IES 





in each of 56 6ccupations.— An average score for each of the 
curricula was also computed on each of the SVIB's occupation- 
al scales. These averages are contained in Appendix A. A 
master magnetic tape was also developed at the NPRDC contain- 
ing €ach individuals responses to each of the 399 items in 
Pnceoviba se(ihesesatem response data were used later in at- 
Llp PSm—eMmecanstnletmovln Scales mpredictiye ols grade averace 
and satisfaction.) 

Becaulse, Of the relatively Small number of oysh bares 1ey/ er gb Ul ye S) 
Pemcaciimot sine Curriculaj, and because some of the vintended 
data analyses would mertice samples larger than could be 
obtained from any single curriculum, an investigation was 
conducted to determine if the SVIB data from some curricula 
could be aggregated. In this analysis, correlations were 
computed among the curricula based upon their scores on the 
S56 occupational keys. Table II shows the correlations that 
were obtained. - 

The correlations in Table JI “indicate that all of the 
Managementwecurricula tendedyto have fairly similar SVIJ3 
profiles with one another, and that the SVIB occupational 
scores from the OR/SA curriculum tended to be more similar 
to those from the management curricula than to those from 
Comoe CmOmCUYTILCUld geeclicelecimabhe Cos and Aero curricula 


SVIB scores tend to be more similar to one another than they 


tRor a@oturther Gese; ipcionedand explanation, Campbel'l, 
Uieees tandpook tor the SGromar Vocational Interest” Blank, 
mealtord University Press. 1,7 1. 


16 





dowte@wany Gf time Other e€urriciuka. Based upon’ these corréla- 
tions, the data from the management (#367, #620, #816, and 
#817) and OR/SA (#360) curricula were aggregated, while those 
from CS (#368) and Aero Eng. (#610) were placed together in 


another set. 


Tabiiter | te 


Intercorrelations Among SVIB Occupational 
Peo les eL0 ie SeMCINCuULr etl d 


Garr veu la 
1 Z 3 4 5 6 7 

ya ayn 87 77 93 84 77.84 
R 2 eet) 96 Oe Bey) 64 83 
R 3 1.00 Lie OM 249 76 
I 4 1.00 oom os 91 
C 5 1200 90 94 
U 6 ee O10 . 86 
L 7 1.00 
A 

1 = ComMet. 

2 = AeroEng. 

om SConp. se serence 

4 = SysAcqMet. 

5 = CompSysMet. 

6 = Met. 

7 = OR/SA 


For data analysis purposes, developmental and cross valida- 
elOmmoTOUpS were then fLormedwes table Il displays the curricula 
and the numbers of officer/students in the various developmen- 


tal and cross validation groups. 


A. PRELIMINARY ANALYSES 
As grades (TQPR's) and satisfaction were to be used as the 


criteria in this research, it was necessary to measure and 


iay 





Tabme EIT: 


Sizes of the Developmental and Crossvalidation Groups 
Used in the Analyses of SVIB Occupational Scores as 


Preuretous sOLeAcademic Grades and Satisflaction 


Management 


817 Mgt. 
620 ComMgt. 
816 SAM 
367 CSM 


ihotat 


CS/Aero 


368 CS 
610 Aero 


melot ail 
OR/SA 
360 OR/SA 


Grand Toitalis 


73 
30 
Sy, 
se 


173 


16 
60 


76 


20 
S01 


Developmental 


understand these variables. 


CTrossy al laa cmon 


ce 


Oc all 


aS 
42 
52 


299 


Zs 


Tez 


1M 
418 


This section describes how the 


criteria data were developed and processed prior to their 


use with the data from the SVIB. 


1. Grades 


Each of the officer/students in the sample (except 


for those in Aeronautical Engineering) reported his grade 


average in his graduate curriculum at NPS. 


average would fall on the following scale: 


B 
C 
D 
Failing 
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Grade Numerical Value 
A 


Thi Semaine mac aL 





Fhe Aeronautical Engineering curriculum presented a 
raqucuproblem, Mowevers..as OffLicer/studénts in that eurricu- 
Mimehad been graded on a ditfterent system. For the purposes 


of this study, grades from Aero were treated as follows: 


Aero Grade System NPS Grade Equivalent Numerical Value 


H A 4 
G B 3 
S C Z 


ime =eradeset@r A€romrng. Students were cComputedmpy the 
author of this thesis based upon records available in the Aero 
Eilo eect rmamci Lun Ort Lecs 

After each of the officer/students in the sample had 
Roper Lcu@or vec assmpned @ TOPRI preliminary investi gation 
om these data were launched. The first question to be an- 
Swerea concerned "tire validity of reported TQPR's. 

ie eNPS gicademie transeripts of 55 Management stu- 
dents (Curriculum #817) were retrieved and the students' com- 
puccd=TOPR'S Compared with their self-reported TQPR's. The 
Correlation between the reported and actual TOQPR's was .99, 
Gmaetncemeans Were 5.57 alg 5.54, Tespectively. The NPS 
adcadchMemerdlsenmpts son aie +7eUl5.Ne Students in Communiceéa- 
tions Management (Curriculum #620) were also obtained, and 
@ieiy actual TQPR's compared with their self-reported IQPR’s. 
ied We 42 cases, tnemr accual and self-reported TQPR’s were 
Svcirt lod cmsCCMCGsODVIOUS eEmat SClf=reported TQPR's pro- 
cidcum at icwmacemrate testamanes Gledecuial NOPR'’s:. Hence, 
most of the analyses reported in this study will utilize 
self-reported TQPR. 
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The second study of TQPR's investigated the longi- 
tudainmalestability of individuals’ TQPR"s. This investiga- 
tion was important for two major reasons. First, if grades 
anccuic Unstabmemover Cie j,M1 ge., the? ordering ®of students 
according to TOPR'’ se changes from quarter to quarter, then 
different variables would likely be important in predicting 
TQPR's in different quarters! of a Curriculum. ‘This would 
have introduced added complexities to this study, although 
tne predictton of TQPR in the final quarter of the curricu- 
lum would still have been of paramount importance. (Though 
the researcher would have to remember that some officers may 
have been removed from the curriculum due to low grades in 
earlier quarters, and this may have been due to low abilities 
ited weds, cys. , Vembal, not required in the later quarters 
Gt thes curriculum. ) 

The second reason for the importance of the grade 
Stability study stemmed from the relatively small sample sizes 
im the different curricula. The set of studénts in a curricu- 
lum consisted of two or more subsets of students that had 
DecimoimEne CUPTICULUM~GTeLeTrentmleneotis Om timecse.in Acre 
Eng., for example, there were student groups that had been 
MmChCmcCurrTeulUi in Sonn moreno duarters. If TQPR's were 
stable over time, then TQPR data from students who had fin- 
ished only a few quarters could be considered as indicative 
of what their TQPR's (or at least their relative standing on 
TQPR when compared with their peers) would be after they had 


SO) CLecmine@i sCUITIUCUIUM a Ande TOPR's after a few quarters 
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€oulad be considered as indicative of later TQPR's, ther the 
subsets of students who had been in the curriculum different 
amounts of time could be merged and used in later statistical 
analyses examining the SVIB as a predictor of TQPR. 

The first analysis of TQPR stability was a longi- 
tudinal study of the stability of grades in the Operations 
Research/Systems Analysis, Management, and Aeronautical En- 
gineering curricula. 

AN eXamination of students’ records in the Operations 
Research/Systems Analysis curriculum office revealed that 
Z25 U.St Nawy officers were currently enrolled in their 
seventh quarter of that curriculum. This is the same number 
ot omticersswho had? enrolled in the’ curriculum over 51x 
quarters previously. Hence, no U.S. Navy officers in that 
mipuc to the w@R/SA curriculum had been lost. Each of the 25 
officers’ TQPR's was computed at the end of each of the six 
quarters that had been completed. Intercorrelations among 
the six sets of TQPR's were then calculated. These correla- 
tions are shown in Table IV. 


Tabalie TV. 


Correlations Among TQPRs After Completion of Different 
Numbers of Quarters of the OR/SA 
CUrricuiunN (Nee oe Sen Orficers) 

1 


Quarters Completed 


1 2 3 4 : 6 
I ee OS SoZ eZ ov roo 


1 
2 1.00 .98 .97 4.96 95 

uarters 
lle 3 1) ey 
4 1.00 .99 99 
: 1.00 1.00 
5 1.00 


1. Each quarter is 12 weeks in length. 
Zl 





As TQPR is a cumulative average, the correlations 
among TQPR's from different quarters are part-whole correla- 
tions. One would therefore expect fairly high intercorrela- 
tionspamongslOPR's) from successive quarters, but the 
Macnucudes of the correlations in Table IV are’ surprisingly 
high. Particularly surprising are the intercorrelations be- 
Eween, |OPReatter one quarter with the TQPRYs atter five 
(r = .90) or six quarters (r = .89). All in all, the data 
in Table IV indicate that TQPR's after two or three quarters 
pea Curriculum Are quite predictive of TOPR'sgaftler six 
Giarte rss 

Students’ grade records were also gathered from the 
Aeronautical Engineering and the Management curricular of- 
fices. A TQPR was computed for each student at the end of 
chee t tte Gguiartersshe had completed. @ ihe. intercorrelations 


among these TQPR's are shown in Tables V and VI. 


Table V. 
Correlations Among TQPRs After Completion of 


Diite LentenumnMDers @mmOldntlens son tne sAcro Ene. 
Ghariculemn eects UeoeN. Officers ) 


Quarters Completed? 


il 2 5 7 
Quarters, ie. 00 .94 ~93 | jutenr 
Completed” 2 0,0 98 90 
3 Jae 92 
7 Peng 


ee Ga CN ie Ue ono mmlemye Clos an lon py chi. 
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hatte FYI. 
Correlations Among TQPRs»sAfter Completion of 


Different Numbers of Quarters of the Management 
Gia eeu nmmcwr ium MN = 55°U.S-2N. Officers } 


Oia Tut Clas Completed! 


1. 2 3 4 5 
1 1.00 87 £85 aon 78 
2 1800 98 96 £95 
Bonoidied! £ 1.00 .98 94 
4 1.00 BO 7 
5 1.00 


ieeeetachiwaquarters 25 i2Zaweeks an length 


The pattern of correlations in Tables V and VI is 
much like that displayed for the OR/SA curriculum in Table 
emcee r two or tEhnree quarters sin his curriculum, an of} 
ficer/students' TQPR after five or more quarters can be 
readily predicted. More specifically, an individual's stand- 
SiO iene misttrtbution Gf IOPR’seaitem five of more quarters 
Solem rc Ohikat COMMON ies GP h sott worn tires sdNanec rs. 
Because of the nature of the correlation coefficient, the 
high correlations among TQPR's shown in the previous tables 
do not mean that the average TQPR's in quarters one or two 
Scuaihecde thc: LQOPR! Shins aye duaruarse five, six, or Seven 
(Guilford, 1965, p. 101). Therefore, an investigation was 
made =to determine thespatterm of average TQPR's over the 
successive quarters in a curriculum. The following tables 
display some TQPR averages from three NPS curricula. - 

Table VII shows the average TQPR's earned by two 


different inputs (January and July 1973) to the Management 
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Labpie evils 


Three Quarter Longitudinal Study of 
Management Students' Quarterly QPRs!1 


Quarter ot Curriculum 


Section ly SM ES 
eet eee 20) Me an 3.38 5, SOAS 
PB Std) Dev. Wei 36 Oy, 
2 (N=23) Mean 20 DS: SS 
Std #eDev. . 39 . 39 DOS 
3 (N=22) Mean SB EONS 3.40 3. 44 
| Std. Dev. coe 26 2s 
Overall Mean 3.30 F,.5 5 3.40 
ae 1 (NALS) Mean 3.32 3.35 3.38 
Ie Std. Dev. 39 36 34 
2 (N=16) Mean 3.38 3.38 3 oAe 
Std. Dev. Bil 35 30 
3 (N=18) Mean 6S Bes2 Bes 
Std. Dev. 38 39 5 
Overall Mean 3.54 Oo. o4 5.358 

1 


As the July 1973 input had only completed three quarters, 
Comparmsonse Gould only bel made for those three quarters. 
wavanswene tromsNPS records, 
curriculum. Each of these two inputs was divided into three 
administrative sections. The student sections are formed in 
a stratified-random procedure, with military ranks defining 
the strata. 

The data in Table VII show that the differences among 
Pion Noa! SON mtnrce 5c C mLOMemEnuaticmSame Input temdsco be 
larger than the differences between the overall means of the 


two inputs. Further, each of the six sections received 
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howe wmeOrk Ss ainetifedis, third quarter than they did in their 
PorS@equarter. 

Rather than risk conclusions concerning issues such 
as “grade creep" based upon omly the data in Table VII, 
analyses were made of the grade averages in several other 
SUunmucula. dS Geportca an Table VIII, 

The _reader should reicall that the data in Table VIII 
are from a cross-sectional sampling. Because of this, one 
cannot know for sure whether or not the differences among 
the TQPR statistics in a curriculum are due to differences 
among the inputs into the curriculum and/or due to changes 
in the courses, standards, eitc., within the curriculum. 

Given the differences among the TQPR's of the management sec- 
tions shown in Table VII, the differences among the mean 
TQPR's for a given curriculum in Table VIII do not appear to 
be larger than might be expected to occur by chance. (The 
possible exception to this assertion 1s in the Computer 
Science curriculum, where two mean TQPR's differ by .22, 

but one of the means was computed from a sample of only 
three.) Based upon these considerations and the data shown 
in the preceding tables, the decision was made to standard 
score the TQPR's for each input into each curriculum. Through 
this) process, the distribution of TQPR's for individuals in 
the same input to the same curriculum was converted to a mean 
of zero and a standard deviation of one. Thus, the standard- 
ization process yielded equal TQPR means and standard devia- 


tions for all of the inputs and curricula. For some of the 
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an aude Scsm mwcported im Later parts of this thesis, the grade 
distribution for each input curriculum group was dichotomized 
at the median, with the high group being coded "2" and the 
Voweeroup being coaed “ir 

2. omatisitaction 

The officer/student'’s satisfaction with his) area of 
Studyewas considered@as@beiniewasMimportant a criterion as 
LOL eel ronmtne individual otficer/student sspoint of view, 
Satisfaction is of obvious importance. From the U.S. Navy's 
point of view, satisfaction with an area of study is impor- 
tant ‘because it relates to the’ officer's desire to use his 
PuveGdtelomein “payback” billets® “ihese billets, called P- 
and D-coded billets (SECNAVINST1520.4A), are considered by 
the Navy as requiring an incumbent having graduate education 
for optimal performance of the tasks in the billet. 

The assessment of an officer/student's Satisfaction 
was made by means of the sr FLARES Re SGN S C:S ailOue a. © Lisamacl 1 cise 
tions buried within a biographical inventory administered to 
the officer/students in the sample. These were items 47, 55, 
59, and 60 in the biographical inventory. Restatements of 
these items are given below. 

47. Do you wish to serve in a billet requiring 

the education that you would receive at a 
graduate school (P-coded billet)?2 


55. Are you satisfied with your education at 
the Naval Postgraduate School? 


“The wording of this item reflects the fact that in later 
Studies it will be administered to officers before they are 
SQlcctcdmaror a €raduatcecurriculun. 


Zed. 
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59. Do you now like your degree curriculum? 


60. Would you choose a different degree curric- 
ulum 2£ you could sitart over again? 


Responses to the four iltems were either "yes" or "no". "Yes" 
responses to items 47, 55, and 59 were scored as plus ones, 
while "no" responses to these items were scored as zeroes. 
"Yes'" responses to item 60 were scored as zeroes, while "no" 
Hesponses wene scorediasi aiplus one.” The intercorme ations 
among the four items and the total satisfaction score were 
computed and examined. See Table IX. 

The patterns of intercorrelations among the four 
satisfaction items and the total score indicated that a total 
score could reasonably be generated by summing an individual's 
Ore scores. torethe four items. 2his? procedure yielded total 
Satisfaction scores of zero through four. The internal con- 
Sroucnc,srellability ot these@total Satisfaction Scores was 
estimated using a method described in Gulliksen (1950, p. 
225). This method, according to Gulliksen, provides the 
lower-bound estimate of the reliability of the set of total 
Satisfaction scores. These reliabilities are given in Table 
X, and show that the percentage of error variance ranges from 
Zee LOmoae(GUIilaksen, p. 26). Ase the reliability estimates 
are lower bound estimates, the sets of total satisfaction 
scores seem to be reliable enough to justify their use as 
Smibec fideo | tL nouch there is obviously room for improvement. 
The set of satisfaction items should be increased in number 
in future research in order to increase the reliabilities of 


BremcoOtal Satistaction scores. 
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Tabike. =). 


Intercorrelations Among the Four Satisfaction Items and Total 
Batis#actiom ocores for Several Curricula 


Com Mgt (620), N = 42 
Items 


letal Sate Ay. 55 59 60 


HMotal Satistaction X .63 .69 .89 -.78 
Item 47 X pag 4) e245 
Item 55 X 25 -.25 
Item 59 X -,66 
Item 60 X 
Management (#817), N = 71 
Motcal Satis kacti om x sOUmee. 77) Sod - ,60 
Item 47 X oS ee -.19 
Item 55 xX BS) - 14 
Item 59 X - .48 
Item 60 x 
AeroEng (#610), N = 91 
Poudleoadtistact1on X Not Computed 
Item 47 , X 4 lee amen lt 
Item 55 xX 50) - .43 
Item 59 X - ,67 
Item 60 Xx 
Table®x. 


Estimated Internal Consistency Reliability of the Total Sat- 
TS hace One oCOresS mt e@rebacwmet Several Curricula 


Curriculum Reliability N 
ComMgt (#620) RS 42 
AeroEng (#610) 78 61 
Management (#817) .65 a 
OR/SA (#360) Bee 74 


inese are lower-bound estimates of the reliabilities. 
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Table XI displays the frequency distribution of the 
EOualmesdtmwShactlom scones tor cach of the curricula input 
groups. 

Table XI. 
Frequency Distributions of the Total Satisfaction 
Scores of the Curricular Input Groups 


(All Wats, are Cross Sectional) 1 


OpsRes./SysAnal. (Curriculum #360) 


Satisfaction 
score Quarter [I Quarter IV Quarter Vi 
4 16 14 Adel 
3 2 i 4 
Z 1 0 i 
1 5 0 Z 
0 a 0 Ee) 
Totals 25 21 0 N=7 4 
Comp. Sys. Mgt. (Curriculum #367) 
Satisfaction 
Score Quarter [I Quarter III 
4 hes: 7 
3 5 9 
2 1 4 
1 7 y 
0 a, wall 
Totals IES 25 N=48 
Computer Science (Curriculum #368) 
Satisfaction 
Deore Quarters Quarter III Oula ait Casey 
4 5 2 Z 
3 6 1 2 
y 1 0 1 
il 2 0 1 
0 2 0 0 
Totals 14 § 6 N=Z5 
AeroEng. (Curriculum #610) 
Satisfaction 
SG Gmc Chae OCrr eel Qtr. V OMI) Oar 
4 4 5 9 10 9 
3 9 7 5 3 2 
Z if Z 3 3 0 
1 4 0 1 4 0 
0 4 3 i 3 0 
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AeroEns. (Curriculum #610) continued’ from Table XI. 


Totals i eZ 20 1a 11 
Com. Mgt. (Curriculum #620) Nees 
Satisfaction 
Dc One Quarter I ORNL Quarter V 
4 6 8 8 
5 4 5 1 
2 0 i 5 
il Z 0 1 
0 0 = ail 
ho tas le? ity 14 N=42 
oyem Acad. Met. (Curriculum, i 816) 
Satisfaction 
Score Glometiegere «Il Quarter III Quarter, 
4 10 9 2 
3 4 4 8 
Z 2 1 3 
il Z 0 3 
0 a2 it i 
Totals 20 5 Zee = Si 
Management (Curriculum #817 
Satisfaction 
SCO me Quarter I Quarles Ona Gee Ca. 
4 9 Vij 20 
3 1 9 6 
Z 0 11 4 
1 3 Z 6 
0 0 ae _0 
Totals 13 45 36 N=94 


The reader is urged to note that the data in Table 
Mimcdoemot represent the results of a longitudinal study of 
Sabistact sonnet) dedloneitudimme satisfaction data have been 
Gor lecteds the practicalysipmifticance Of some of the patterns 
in Table XI cannot be known, as differences between quarter 


CEouUps Tieameunriculunm could be due to differenceS among 
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officer/students and/or "caused" by the ongoing educational 
Caper TenGesmOneene sO1L1Cer/ students. 

tThe® frequemey disStripucions) O@ethe total Slatisifac- 
tion scores make one point rather clear: the satisfaction 
scores had a ceiling that was too low. In some curricula, 
Cros OR/SA, the preponderance of the total Ssatisfactuion 
Seones were fours. If additional items had been included 
in the set of items addressing satisfaction, a less skewed 
doistribubion of totall satisfaction scores might have result- 
ed. The practical importance of obtaining a less skewed dis- 
tribution is multifold, as officer/students who were "really" 
different in their levels of satisfaction would be less 
likely to receive the same total satisfaction scores, and as 
the usual correlational measure, the product-moment correla- 
El One Ss TeEStricted im Magnitude when distributions are non- 
symmetric (Caroll, p. 349). Future research on the satisfaction 
of officer/students should utilize a revised total satisfac- 
tion scale. 

The other preliminary analyses were made using the 
total satisfaction scores. First, the correlations between 
the total satisfaction scores and the standardized TQPR's 
were computed for several of the curricula. These correla- 
fions#ame shown 1n Table XW Second, the distributions of 
total satisfaction scores from the different curricula were 


compared. 


The correlations shown in Table XII vary consider- 


ably: from essentially zero in Management to .33 in the OR/SA 


SZ . 





Lables cy 


Correlations Between Standardized TQPR's 
Meme scatistactionm Scores tor 
Seve ral urriecu la 


Curriculum N Correlatvon Between #OPR 
and Satisfaction 


ComMgt (#620) 42 LS 
Aero ‘Eng (#610) 91 24 
Met fi Oe jell nO 7 
OR/SA (#360) 74 a5 


EUrpucuiumweeAnNoether way to consider these correlations is te 
Say that in Management one cannot predict TQPR from satisfac- 
PaommOmvICce Versa. but about 114 el Sa xe JHU ese aie 
Variance in TQPR can be predicted (with a linear model) from 
Satisfaction, or vice versa. In sum, the criteria of satis- 
faction and TQPR appear to be relatively independent of one 
another. 

The total satisfaction score distributions from the 
seven curriculafor which these scores were available were 
contrasted with one another. Before making these compari- 
sons, the data from the different quarter groups in a cur- 
riculum were aggregated. The Kolomogorov-Smirnoff two 
Sample test was used to make the comparisons, rather than 
using an analysis of variance because of the skewed distri- 
butions and unequal sample sizes (Siegel, pp. 127-136). The 


results of these tests are shown in Table XIII. 
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As shown in Table XIII, only two of the 21 K-S tests 
were statistically significant at the .01 level. (Because 
of the number of comparisons, the relatively conservative 
70s) level wast chosen.) Both of these Statistically signi- 
ficant comparisons involved the OR/SA curriculum--with the 
other curricula being Aero. Eng. and Computer Science. An 
inspection of the cumulative frequency distributions showed 
Enat the, OR/SA disitribution contained wagreater proportion 
of scores equal to four (the highest satisfaction score 
possible) than did the other two distributions. 

Prior to using the set of satisfaction scores from 
a curriculum as a criterion to be predicted using the SVIB, 
EheeLOLdIe Sdtistaction Seores from each Gurriculum input 
group were dichotomized. Although it was desired to split 
each group at the median of its total satisfaction score 
distribution, it was not possible to do so in many cases due 
to the skewness of those distributions. When it was not possible 
to split the distribution at the median, the split was made 
between satisfaction scores, but as near the median as pos- 
sible. Table XIV documents the way the various total satis- 
faction score distributions were split. (Table XI contains 
the original distributions.) 

The dichotomized total satisfaction scores were then 
recoded "1" or "2" for the low and high groups, respectively. 
These recoded scores were used as criterion data in some of 


the analyses using the SVIB as a predictor of satisfaction. 
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able XIV. 


High-Low Total Satisfaction Group Sizes for 
Sevenecurricula - Data iain Tadle 
are Numbers of Officer/Students 


Aero. Eng. Ofr. | Otr, del Otr. V Ota. Vii Shee 1 
Hi 3 ii 9 13 9 
Low 9 5 11 10 2 
SONpUtenr oCLence Qtr. I @teya Li Ohese 5) 
Hi 9 2 2 
Low 5 i 4 
Management Qtrs’. I Oir.. 11 Otrae ry 
Hi » <9 Zz 20 
Low 4 ZS 16 
Comp. Sys. Management Oia we! Game oy JUIN 
sett 185 16 
Low 10 i 


Communications Management Cer, | (0) 2 es): Le OCT aaa 


Hi 6 8 8 
Low 6 8 6 
Sys. Acq. Met. Qtr. a Oot. Je Ot eee 
Hi 10 9 10 
Low 10 6 ‘i 
Ops. Res./Sys. Anal. Ocre i Ot eel V Qtr. Vii 
Hi 16 14 ali 
Low 7 i 9 


36 








PeeenNAL Kobo USING SVIB OCCUPATIONAL SCALE SCORES TO PREDICT 
TQPR AND SATISFACTION 


Stepwise multiple regression procedures were used in an 
Eire PpredicimlolLR tfrommscores on the SVIB occupational 
Seabes, ) The Statistical Package for the Scoial Sciences 
(SPSS) (Nie, et. al.) multiple regression program was used 
for these analyses. 

Peer ChOtOmi 2 Cdmbor hk as van Unter on 

Multiple regression equations were formed separately 
for the Management, CS/Aero, and OR/SA developmental groups 
(see Table III for the sample sizes) using the SPSS stepwise 
multiple regression program. These runs can be summarized 
rather tersely: all of the multiple correlations looked 
promising in the developmental samples, but collapsed in 
the crossvalidation runs. The crossvalidations, which allow 
an estimate of the mean square error of a sample regression 
SQUatroOnm I netne popllations(JarlLineton,e pe. | 74) , andicated 
that the equations would not be useful for BuPers when mak- 
ing predictions of TQPR. 

Ls Sten dacdived ROP tas 7a Griterion 

As was described earlier in this thesis (see page 
Ze weneomais tl 1DUt TOM cme Oo) ilcmseOmmEnc "OL1L1CeT/ Students in 
each curriculum and quarter group was standardized to a mean 
of zero and standard deviation of one. These standardized 
distributions were then combined for the developmental groups 


described in Table III, and the combined standardized TQPR 
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distributions used as criterion information in multiple re- 
gression analyses with the SVIB occupational scale scores 
as predictors. 
3. Computer Science and Aero Eng 

Earlier in this thesis, it was mentioned that the 
data from the CS and Aero curricula had been aggregated be- 
cause of the high intercorrelation between their mean oc- 
Supattome: Score oVIB profiles Hence, one of the multiple 
regression runs investigated whether or not the standardized 
TQPR's in this aggregated sample could be predicted using 
ene beoccupatwonalyscales- eilhe standardized LQPR"S 
could not be predicted, as the crossvalidation collapsed 
(the multiple R in the crossvalidation group was near zero). 

In another attempt to develop an equation useful in 
predicting standardized TQPR's, the data from CS students 
were removed and a multiple regression analysis made using 
only data from the Aero Eng officer/students. 

4. Aero Eng 

Stepwise multiple regression was used to locate and 
mel Cites, Ib oOccupattomaliesccales predictive of Aero Eng TQPR, 
and the resulting equation was then crossvalidated. This 
analysis yielded a very simple model which held up fairly 
well under ross val cation Table XV shows the relevant 
data. 

ioe roscoValidatedscomclatlvOnwG; «1.20 in lable XV 
would be significant at a type I error level of .087. The 


correlation is hardly huge, but it could prove useful to 
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TW) IS we 


Pred tae lonroesNero Ene TOPR 
from SVIB Occupational 
Seale Scores 


SVIB 

PREDNCTOR DEVELOPMENTAL DEVELOPMENTAL X-VAL X-VAL 
SCALE R N R B CONSTANT N 
BO TCS 

Service 40 89 P20 rua 5 55 2S 
Dens wt oureS: t fad 2 ane expectancy charts, which are MEMS) = 


ful in understanding the usefulness of this correlation (Lawshe, 
Cite be) 

individual expectancy charts#anelparticularly helpful 
for the individual officer considering whether or not to at- 
tend a curriculum such as Aero Eng, because he can be provided 
an estimate of his probability of attaining an above average 
ZOPR in that curriculum. The institution, say the Bureau of 
Persomncile "came bDetter USC FPI@Ure =Z,,asS It ¥showS@the percent- 
dee Of Officers who can be expected*to attain grades above 
the median grade if they choose the top "X%'" of the officers 
aeeording to the predictor scores. § 

DiwoOnes Sense, © tseebvyigusly impossible to select 
officer/students such that more than 50% of them will re- 
ceive grades above the median, because the median is the point 
above, and below, which 50% of the scores fall. It is pos- 


Sible, however, to select officer/students who will perform 
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above the median grade in the current sample (a grade of 
about 3.16). An assumption being made here is that pro- 
fessors have some absolute standards in mind, and do not 
merely grade students relative to one another. Unless this 
assumption is true, the officer/students will all have to be 
Polat ly excellent Students so that the professors cannot 
grade them using the "curve", or the officer/students will 
find the curve has simply moved upward and the median grade 
Will sitill be far esis than an ‘'A'. 

Pio vreSmomamde 4 dre thesexpcectancy charts tor pre- 
dicting Aero Eng TQPR in a form more useful for BuPers. 
The préediveted TOPR's utilized in Figures Seand 4 are computed 
from the equation given in Table XVI and mapped on the "raw" 
TQPR Houle” 

.5. Management Curricula 

The stepwise multiple regression proceduee was used 
to attempt to develop an equation using SVIB occupational 
scales as predictors of standardized TQPR. An equation using 
three SVIB occupational scales yielded a crossvalidated R of 
Pe omewiilen, wath a samplessazeo of 50, 1S Slpnifticant at the 
.021 level. (The reader should refer to Table III for the 


curricula represented in this part of the analysis.) 


spredicted TORR Saverescomputcamusing the mean and stan- 
dard deviation of the QPRs predicted along with the mean 
and standard deviation of the “"raw'' TQPR's for the cross- 
validation sample (See McNemar, p. 38). 


40 





pa nee valle 


Prediction of Management Curricula Standardized 
TQPR from SVIB Occupational Scales 


SViIBsca lie Weight Constant X Val R X Val N 
(B) 

Artist pee) 22 

Millie Olece ait 1 Cer sary Umer) 2000 20 60 

Computer Programmer ~047 


Figures 5 and 6 are expectancy charts helpful in 
using the obtained relationship in predicting Management 
TOPR's.4 

6. Ops Res/Sys Analysis Curriculum 

Usoneethree of the SVIB occupational scales, vaycrogs- 
validation multiple Reof .S$9 was obtained. Table AVET con- 
tains the data for this’ -equation. 

Figures 7 and 8 are expectancy tables which can be 
used in predicting TQPR's in the'OR/SA curriculum. > 

a. Satisfaction As a Criterion 

All of the stepwise multiple regression analyses 
that were Tun, With satisfaction as a criterion and SVIB oc- 


cupational scale scores as predictors, failed to hold-up under 


erossvalidation. 


nie SGMputTe Predicted eowemuOrk Ss the sollowing equa- 
tion was used (McNemar, p. 38): 


fOr hee der O72. SOU OommeGeAlT orce Score -,022 x VArtist 
mo) osecomputer Programmerjime+ 3.143. 


The following equation was used to compute predicted raw 
ere l@rrk Pred. -me4509(=223870 + (052 x Psych. - .014 x 
PVC Mao l xX CPA) + ae oe 





Tablewy ii 


Predietion ofyOR/SAX Standardrzed 
TQPR from SVIB Occupational 


Scales 
ov ib oeale Weight Constant X Val R X Val N 
(B) 
Psychologist nO 2.07 0 og om 
YMCA Secretary -,014 
Senior CPA ,0S2 


The prediction of satisfaction will therefore 
have to be done in some other way, perhaps beginning with an 
expanded number of satisfaction-related questions in the 


biographical questionnaine (see pages) 27 and 28). 
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FIGURE 1. 


Aero Eng Individual Expectancy Chart for 
Predicting TQPR Using SVIB as the Predictor 


Top 202% 
Predictor 
Score Next 202 
Distribution 
Category Next 202 
Next 20% 


Bottom 202% 





Probability of Attaining 
Above Median TQPR 


. Figure 2. 


Aero Eng Institutional Expectancy Chart 
for Predicting mi QPR 


Hi 204 
4 Hi 4024 
Predictor 
Score Hi 602 
Category 
Hi 804 
All 





0 50 100 


Percentage Attaining Above 
Median TQPR 
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Figure 3. 


Aero Eng Individual Expectancy Chart: 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 


3.38 to 4.00 


eee BSae8ato 3.4375 


TQPR ao lake 3.27 5 
Category 


a e070 to 3.14) 5 


<—3.0695 to 3.0695 





Probability of Attaining 
Above Median TQPR 


Figure 4.. 


Aero Eng Institutional Expectancy Chart: 
Predicted TQPR vs. Percentage Attaining An Above 
Median TQPR 


= Smee 

Predicted = 3.28 

TQPR > 3.15 
Category dna 

— 3507 

All 





0 50 100 
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Figure 5. 


Management Curricula Individual Expectancy Chart: 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 
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Figure 7- 


OR/SA Individual Expectancy Chart: 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 
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V. CONCLUSIONS 


With the high cost of advanced education, both in terms 
of dollars and time away from operational units, it is 
Mitaity important "that the resources of all descriptions 
available for this education be used as efficiently as pos- 
SIDLOm@eOne “way to Improve! efficiency is to do the besit job 
POSS1b LE -OLF Choosing the ysStucents.  —The investigation re- 
pertca in the preceeding pages eoncerns improving, that ef- 
Bcc Weyeme tots Centered on tae otrong VOCatioman Interest 
Blank (SVIB) which has shown some promise in predicting 
academic success in various circumstances and has been used 
by the Navy in several other applications. The Personnel 
Research and Development Center (NPRDC) in San Diego is 
well-acquainted with the SVIB and can easily handle scoring 
of the tests on either an occupational scale basis or an 
item response basis. 

moe analySlS Treportcdsimetnis paper, indicated some veny 
useful relationships between SVIB occupational scales and 
academic performance as indicated by TQPR. A predicted TQPR 
can be computed for a man applying to a given curriculum 
using a simple equation including several scale scores as 
the factors with appropriate weightings. It was found that 
Sevieral curricula could be merged to yield larger sample 
selzesebpceause of the lwenecornetations among their scale 
scores. This was possible with the regular management, CSM, 


SAM, and communications management groups. CS and Aero were 
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merged, also. Several regression runs were made with OR/SA 
Merced aiken ManaveMmectemcunnretla but results were not 
nearly as good as when the groups were used separately. 

An important faspect’ of the life ofa modern naval of- 
ficer is his satisfaction with his duties and chosen speci- 
Phi wlneretOre lt.1s dceSinable to predict an officer's 
Samsfaction with a curriculum amd future P- or D- coded 
baritets | thismenhances career planning for the officer and 
Supports the organizational development of the Navy. Un- 
fortunately, this investigation into prediction of satis- 
faction has failed to reveal a useful prediction method 


using the SVIB occupational scales. 
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